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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). tn no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 06 January 2004 . 
2a)^ This action is FINAL. 2b)D This action is non-final. 

3) n Since this application is in condition for allowance except for fornnal matters, prosecution as to the merits is 

closed In accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-21 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) S Claim(s) 3,6,10-12 and 19-21 is/are allowed. 

6) KI Claim(s) 1-2, 4-5. 7-9 and 13-18 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification Is objected to by the Examiner. 

10)n The drawing(s) filed on is/are: a)n accepted or bjD objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required If the drawing(s) is objected to. See 37 CFR 1.121(d). 
11 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)U None of: 

Certified copies of the priority documents have been received. 
2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachinent(s) 

1 ) CH Notice of References Cited (PTO-892) 4) □ Interview Sunnmary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date . 6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mall Date 7 
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DETAILED ACTION 



1 . This action is responsive to communications: Amendment A filed 01/16/2004 to the 
original appUcation filed 01/28/2000. 

2. Claims 1-21 are currently pending in this appHcation. Claims 1, 4, 9 and 13 are 
independent claims. 

3. If a copy of a provisional application listed on the bottom portion of the accompanying 
Notice of References Cited (PTO-892) form is not included with this Office action and the PTO- 
892 has been annotated to indicate that the copy was not readily available, it is because the copy 
could not be readily obtained when the Office action was mailed. Should applicant desire a copy 
of such a provisional application, applicant should promptly request the copy from the Office of 
Public Records (OPR) in accordance with 37 CFR 1.14(a)(l)(iv), paying the required fee under 
37 CFR 1.19(b)(1). If a copy is ordered fi-om OPR, the shortened statutory period for reply to 
this Office action will not be reset under MPEP § 710.06 unless applicant can demonstrate a 
substantial delay by the Office in fulfilling the. order for the copy of the provisional application. 
Where the applicant has been notified on the PTO-892 that a copy of the provisional application 
is not readily available, the provision of MPEP § 707.05(a) that a copy of the cited reference will 
be automatically fiirnished without charge does not apply. 
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Rejections - 35 USC § 102 



4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b),by another filed in the 
United States before the invention by the applicant for patent or (2)a patent granted on an application for patent by 
another filed in the United States before the invention by the applicant for patent, except that an international 
application filed under the treaty defined in section 351(a)shall have the effects for the purposes of this subsection of an 
application filed in the United States only if the international application designated the United States and was 
published under Article 21(2)of such treaty in the English language; or " (Emphasis added.) 

Claims 1-2, 4-5, 7-9 and 13-18 remain rejected under 35 U.S.C. 102(e) as being 
anticipated by Smith et al. (U.S. 6,223,183). 

As to independent claim 1, Smith teaches a method of describing a multiple level digest 
segment information scheme for multimedia contents in order to provide multiple levels of digest 
streams for each multimedia content with small amount of additional storage (uniformly 
describing space and frequency views... including regions, tilings and hierarchical 
decompositions of image, video, audio content, and time series data in space, time, frequency 
and resolution. The space and frequency view description scheme provides a way to specify 
regions in space, time, frequency and resolution in term of space and frequency views\ Abstract) 
in accordance with an embodiment comprising the steps of: 

- describing the level information of digest segments by multiple levels in the 
content-based data area of the multimedia stream {describe any arbitrary multi-resolution 
decomposition of any number of levels of the image or video data; col. 6, lines 41-55); 



Application/Control Number: 09/493,603 Page 4 

Art Unit: 2176 

- describing the digest level information and the time range information of each digest 
segment in a digest segment information structure (the space and frequency view description 
scheme defines several object classes for specie regions in multi-dimensional rectangular region 
in space and frequency ...to describe locations, durations, sizes and regions in space and 
frequency; col. 7, lines 9-30/ The view requests can be represented in the form ofSFViews to 
provide a uniform, standard interface for specifying the space, time, frequency and resolution 
parameters of the views; col. 11, lines 15-23); and 

- describing digest segment information scheme with a set of digest segment information 
structures (the space and frequency view description scheme can provide an abstraction layer 
between image, video and audio description schemes; col. 10, lines 30-50/it can be important to 
describe the color of different regions of the image... The space and frequency view description 
scheme can be used to specify each of the regions in terms of SFViews, and by associating a 
color measurement function with the space and frequency view descripiiun sckerr^^i col. 12, lines 
10-18 and Fig 15). 

As to dependent claim 2, Smith teaches the time range information is the start point and 
end point of or the start point and duration of the digest segment (col.4, lines 13-65). 

As to independent claim 4, the rejection of independent claim 1 above is incorporated 
herein in full. However, claim 4 further recites "a digest stream information scheme with a set of 
digest level headers." 

Smith teaches a digest stream information scheme v^th a set of digest level headers 
(col 8, lines 32-45 & Fig 10). 
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As to dependent claim 5 includes the same limitations as in claim 2, and is similarly 
rejected under the same rationale. 

As to dependent claim 7, Smith teaches the digest level headers can be arranged with the 
order of importance (level) in order to construct a digest stream from multi level digest segment 
information scheme fast (Fig. 10), 

As to dependent claiin 8, Smith teaches the digest level segment information structures 
can be arranged with the order of their time range information in order to construct a digest 
stream from multi level digest segment information scheme fast (col.5, lines 13-65), 

As to independent claim 9, Smith teaches a method of generating multiple levels of 
digest streams for multimedia contents (uniformly describing space and frequency views... 
including regions, tilings and hierarchical decompositions of image, video, audio content, and 
time series data in space, time, frequency and resolution. The space and frequency view 
description scheme provides a way to specify regions in space, time, frequency and resolution in 
term of space and frequency views; Abstract) in accordance v^th the present invention 
comprising the steps of: 

- detecting the digest level and time range information of the digest segment information 
structures from the multiple level digest stream information scheme contained in the 
content-based data area of the multimedia stream (the space and frequency view description 
scheme defines several object classes for specie regions in multi-dimensional rectangular region 
in space and frequency ...to describe locations, durations, sizes and regions in space and 
frequency; col. 7, lines 9-30/ The view requests can be represented in the form ofSFViews to 
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provide a uniform, standard interface for specifying the space, time, frequency and resolution 
parameters of the views\ col 11, lines 15-23); 

- when a condition is queried by the user, generating a multiple level digest stream by 
arranging the digest segments with a priority of more than a certain level corresponding to the 
condition in a time sequence (the client can send the requests for different multi-resolution sub- 
region views to the server. The server can respond by retrieving the views from storage and 
transmitting the results to the client. The view requests can be represented in the form of 
SFViews to provide a uniform, standard interface for specifying the space, time, frequency and 
resolution parameters of the views. The data at the server can also be represented using 
SFPartitionings or SFHierarchical decompositions to provide a standard way for accessing the 
views; col 10, line 6 5 -colli, line 23), 

As to independent claim 13, the rejection of independent claim 9 above is incorporated 
herein in full. However, claini 13 recites: 

- a user input unit; and 

- a decoder for decoding digest segments of the above digest level from the multimedia 
stream signal. 

Smith teaches: 

- a user input unit (a client application can send requests for views of images; abstract); 

- a decoder for decoding digest segments of the above digest level from the multimedia 
stream signal (The view requests can be represented in the form of SFViews to provide a 
uniform, standard interface for specifying the space, time, frequency and resolution parameters 
of the views. The data at the server can also be represented using SFPartitionings or 
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SFHierarchical decompositions to provide a standard way for accessing the views\ colli, lines 
14-23). 

As to dependent claim 14, Smith teaches the condition is the running time of a digest 
stream (col. 5, lines 13-53), 

As to dependent claim 15, Smith teaches the condition is one of a time constraint of 
digest stream, a level information of digest stream, an occurrence of an event, an appearance of a 
person, a background, an object, situation information about of event, person, object, background 
(coL5, lines 13-53 & Figs, 12-14). 

As to dependent claim 16, Smith teaches the condition is combination of a time 
constraint of digest stream, a level information of digest stream, occurrence of events, 
appearance of persons, backgrounds, objects, situation information about of events, persons, 
objects, backgrounds (col.5, lines 13-53 & Figs. 12-14). 

As to dependent claim 17, Smith teaches a digest level information and a time range 
information, and/or the information of the sum of the running time of each digest segment are 
contained in the digest level (col 3, lines 14-20 & col 5, lines 13-53). 

As to dependent claim 18, includes the same limitations as in claim 2, and is similarly 
rejected under the same rationale. 
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Allowable Subject Matter 



4. Claims 3, 6, 10-12 and 19-21 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 



5. Applicant's arguments filed 01/06/2004 have been considered but they are not 
persuasive. 

Applicant argues that because the U.S. Patent and Trademark Office has not provided the 
Smith provisional application, the outstanding rejection based upon the Smith patent should be 
withdrawn. (Remarks, page 10) 

In response, a copy of the Smith provisional application is provided, and Smith reference 
is remained for rejection. 



6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

7. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is 
reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 



Response to Arguments 



Conclusion 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated fi'om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

8. Any inquiry conceming this communication or earlier communications fi"om the 
examiner should be directed to Maikhanh Nguyen whose telephone number is (703) 306-0092. 
The examiner can normally be reached on Monday - Friday from 9:00am --5:30 pm. 

If attempts to reach the examiner by telephone are unsuccessfial, the examiner's 
supervisor, Joseph H Feild can be reached on (703) 305-9792. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpubUshed 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Maikhanh Nguyen 
March 15,2004 




SUPERVISORY EXAMINER 



